ESVIO: Event-Based Stereo Visual Inertial Odometry

نویسندگان

چکیده

Event cameras that asynchronously output low-latency event streams provide great opportunities for state estimation under challenging situations. Despite event-based visual odometry having been extensively studied in recent years, most of them are based on the monocular, while few research stereo vision. In this letter, we present ESVIO, first visual-inertial odometry, which leverages complementary advantages streams, standard images, and inertial measurements. Our proposed pipeline includes ESIO (purely event-based) ESVIO (event with image-aided), achieves spatial temporal associations between consecutive streams. A well-design back-end tightly-coupled fused multi-sensor measurement to obtain robust estimation. We validate both have superior performance compared other image-based baseline methods public self-collected datasets. Furthermore, use our perform onboard quadrotor flights low-light environments. Autonomous driving data sequences real-world large-scale experiments also conducted demonstrate long-term effectiveness. highlight work is a real-time, accurate system aimed at

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Consistency of EKF-Based Visual-Inertial Odometry

In this report, we perform a rigorous analysis of EKF-based visual-inertial odometry (VIO) and present a method for improving its performance. Specifically, we examine the properties of EKF-based VIO, and show that the standard way of computing Jacobians in the filter inevitably causes inconsistency and loss of accuracy. This result is derived based on an observability analysis of the EKF’s lin...

متن کامل

Direct Stereo Visual Odometry based on Lines

We propose a novel stereo visual odometry approach, which is especially suited for poorly textured environments. We introduce a novel, fast line segment detector and matcher, which detects vertical lines supported by an IMU. The patches around lines are then used to directly estimate the pose of consecutive cameras by minimizing the photometric error. Our algorithm outperforms state-of-the-art ...

متن کامل

High Altitude Stereo Visual Odometry

Stereo visual odometry has received little investigation in high altitude applications due to the generally poor performance of rigid stereo rigs at extremely small baseline-to-depth ratios. Without additional sensing, metric scale is considered lost and odometry is seen as effective only for monocular perspectives. This paper presents a novel modification to stereo based visual odometry that a...

متن کامل

REBECQ, HORSTSCHAEFER, SCARAMUZZA: EVENT-BASED VISUAL-INERTIAL ODOMETRY1 Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization

Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odometry pipeline for such cameras that leverages their ou...

متن کامل

Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization

Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odometry pipeline for such cameras that leverages their ou...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE robotics and automation letters

سال: 2023

ISSN: ['2377-3766']

DOI: https://doi.org/10.1109/lra.2023.3269950